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DATA PROCESSORS 

This invention relates to data processors, and is concerned 
particularly although not exclusively with the matching of and subsequent 
5 processing of data. 

In known data matching processors, one enters query data to be 
matched with existing known data. To find a match, the query data is 
compared with all known existing data until a match is found. This can be 
a slow process, even with substantial processors. 

^0 Thus, a problem with such processors is in achieving data matching 

and processing at an acceptable speed, with realistic resources. Many 
known processors organise stored data in fields (as in a database), so that in 
order to find a stored record, the data in the query must also be organised 
into fields (e.g. street name, town, postcode, etc.). In many cases, the field 

1 5 names may be unknown. For example, in entering as query data a postal 
address to be matched, one may not know if a word belongs to a ^'street'* 
field or a *town* field. 

Preferred embodiments of the invention aim to provide data 
processors that provide rapid matching of query data that can be of much 
20 greater length, and which can remove the need for additional identifiers 
such as field names. In other words, query data can be entered, largely 
irrespective of order. 

According to one aspect of the present invention, there is provided a 
data processor comprising: 
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a) a correlation matrix memory arranged to store data; 

b) mput means arranged to receive sets of input data to be stored in the 
correlation matrix memory; 

c) a sampler arranged to derive, from each set of input data, a respeaive 
5 set of tuples; 

d) a coder arranged to code each of the tuples; 

e) a combmer arranged to combine the coded tuples for a respective set 
of input data; 

£) a separator generator arranged to generate for each set of input data a 
10 respective, associated, unique separator; 

g) storage means arranged to store the association of each separator 
with its respective set of input data; and 

h) addressing means arranged to applying to the correlation matrix 
memory, for each set of input data, the respective combined coded 

15 tuples as a row address and the respective imique separator as a 

column address, or vice-versa. 

Preferably, the combined coded tuples for each set of input data are 
m the form of a binary coded word; the data processor further comprises a 
translator arranged to translate each such binary coded word into a 
20 translated word comprising index values representing which bits of the 
binary coded word are set; and said addressing means is arranged to apply 
the translated word to the correlation matrix memory. 
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Preferably, said separator generator is arranged to generate separators 
in a random manner. 

Preferably, said separator generator is arranged to generate separators 
which are M bits wide and having N bits set, where N>1 or N=l, and 
5 where N < M. 

Preferably, for each said set of tuples, each tuple comprises three 
successive elements of a respective set of input data, and each successive 
tuple is offset by one such element from the preceding tuple. 

Preferably, said coder is arranged to code said tuples by tensoring. 

10 Preferably, said combiner is arranged to combine the coded tuples 

for a respective set of input data, by superimposition. 

Preferably, at least some of the rows (or coltmms) of the correlation 
matrix memory are represented by binary words, each of which represents 
the positions of each bit in the respeaive row (or column) which is set. 

16 Preferably, said correlation matrix memory comprises a plurality of 

sub-correlation matrix memories; said addressing means is arranged to 
access a first one of said sub-correlation matrix memories and apply the 
combined coded tuples of a respective set of input data to that sub- 
correlation matrix memory unless a respective row (or column) of that sub- 

20 correlation matrix memory will become saturated by application of those 
tuples; and in the event of such prospective saturation, access successive 
ones of the sub-correlation matrix memories imtil those tuples can by 
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applied to a respective one of the sub-correlation matrix memories without 
such saturation. 

A data processor according to any of the preceding aspects of the 
invention may be arranged to receive sets of query data to be matched with 
5 sets of input data stored in the correlation matrix memory, and to derive, 
for each set of query data, a respective set of coded tuples analogous to 
those derived for the original input data, and to apply to the correlation 
matrix memory, for each set of query data, the respective combined coded 
tuples as a row (or colunm) address: the data processor further comprising: 

10 i) output means for outputting a raw superimposed separator which 

represents, for a respective set of query data, the number of rows (or 
columns) having a bit set by the applied combined coded tuples in 
each column (or row) represented by the raw superimposed 
separator; 

15 j) threshold means arranged to convert the raw superimposed separator 

into a binary superimposed separator; and 

k) an extractor arranged to extract individual separators from the 
binary superimposed separator. 

Preferably, said thresholding means sets an absolute threshold value, 
20 and provides said binary superimposed separator as a word in which bits 
represent respective columns (or rows) of the correlation matrix memory, 
and each of those bits is set if the number of rows (or columns) having a bit 
set by the applied combined coded tuples in the respective column (or row) 
equals or is greater than said absolute threshold value. 
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Said thresholding means may determine a value k, and provide said 
binary superimposed separator as a word in which bits represent respective 
columns (or rows) of the correlation matrix memory, and are set for the k 
respective columns (or rows) having the highest number of rows (or 
5 columns) which have a bit set by the applied combined coded tuples in the 
correlation matrix memory. 

A data processor as above may further comprise back-checking 
means arranged to compare sets of recalled data, identified by respective 
separators extracted by said extractor, with original query data, in order to 
10 identify the set or sets of recalled data which matches best the original 
query data. 

A data processor according to any of the preceding aspects of the 
invention may be arranged to process sets of input data and query data in 
the form of postal addresses. 

15 According to another aspect of the present invention, there is 

provided a method of processing data, comprising the steps of: 

a) receiving sets of input data to be stored in a correlation matrix 
memory; 

deriving, from each set of input data, a respective set of tuples; 
coding each of the tuples; 

combining the coded tuples for a respective set of input data; 



b) 

20 c) 
d) 
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e) generating for each set of input data a respective, associated, unique 
separator; 

{) storing the association of each separator with its respective set of 
input data; and 

g) applying to the correlation matrix memory, for each set of input 
data, the respective combined coded tuples as a row address and the 
respective unique separator as a column address, or vice-versa. 

According to another aspect of the invention, there is provided a 
method of processing data comprising the steps of: 

a) receiving sets of query data to be matched with sets of input data 
stored in a correlation matrix memory by a method according to the 
preceding aspect of the invention; 

b) deriving, for each set of query data, a respective set of coded tuples 
analogous to those derived for the original input data; 

15 c) applying to the correlation matrix memory, for each set of query 

data, the respective combined coded tuples as a row (or column) 
address; 

d) outputting a raw superimposed separator which represents, for a 
respective set of query data, the number of rows (or columns) having 
20 a bit set by the applied combined coded tuples in each column (or 

row) represented by the raw superimposed separator; 



10 
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e) converting the raw superimposed separator into a binary 
superimposed separator; 

f) extracting one or more individual separator from the binary 
superimposed separator; and 

5 g) identifying the or each respective original set of input data from 

association with the or each individual separator extracted from the 
binary superimposed separator. 

Any of the above methods may be carried out by a data processor 
according to any of the preceding aspects of the invention. 

10 Any of the above methods may incorporate any of the features 

disclosed in this specification, claims and/or drawings. 

For a better understanding of the invention, and to show how 
embodiments of the same may be carried into effect, reference will now be 
made, by way of example, to the accompanying diagrammatic drawings, in 
1 5 which: 

Figure 1 is an illustration of a correlation matrix memory (referred 
to herein for convenience as a "CMM**); 

Figure 2 illustrates tupling, tensoring and coding of a simple input 

word; 

20 Figure 3 is an illustration similar to that of Figure 1, but showing an 

output array of summed values; 
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Figure 4 is a block diagram of a data processor comprising one 
example of an embodiment of the invention; 

Figure 5 illustrates an example of steps carried out by the data 
processor of Figure 4, to locate data stored in the correlation matrix 
5 memory of the data processor; 

Figure 6a shows a conventional implementation of a CMM line; 

Figure 6b shows an alternative implementation of a CMM line; 

Figure 7 shows line usage thresholds for compressed CMMs; 

Figure 8 shows memory requirement for various sizes of CMM; 

10 Figure 9 shows relative memory savings for various sized CMMs, 

using compression; and 

Figure 10 is an illustration of an MBI (''Middle-Bit-Indexing") 
extractor. 

The basic principle of operation of a correlation matrix memory 
15 (CMM) is illustrated in Figure 1. The CMM is illustrated as having a 
plurality of rows and columns. The intersection of each row and column in 
Figure 1 represents one bit of memory so that, conceptually, the CMM 
comprises many one-bit cells, each initially set to *0'. During a teaching step, 
during which data is stored in the CMM, every cell at the intersection of an 
20 aaive row and an active column is set to '1', regardless of its current state. 
Other cells are left unchanged. 
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Thus, in Figure 1, the intersections with a solid dot • have previously- 
been set to whilst additional intersections with a hollow dot O are newly 
set by the illustrated row address pattern 001000010 and column address 
pauern 010000100. 

5 To recall data from the CMM of Figure 1, a row address pattern is 

applied, and a row is addressed only when a 'V appears in the row address 
pattern. For each column, a sum is generated of all intersections set at *1* in 
all rows addressed by the appUed row address pattern, and the sum is 
subsequently processed. 

10 For example, if the row address pattern illustrated in Figure 1 is 

apphed again as queiy data to the CMM, in a recall step, then the column 
sum pattern 020100210 as illustrated would be obtained, as representing the 
number of intersections set at *1' in each of the columns, for all of the 
addressed rows. Figure 1 is a very simple example to illustrate the mode of 

1 5 operation. In practice, one would expect the numbers of intersections set at 
'1' to be rather higher, for at least some of the columns. 

An understanding of the configuration and use of a CMM such as 
illustrated in Figurel in an embodiment of the invention may be made easier 
by use of a specific example. Thus, there will now be described an example 
20 of storing and retrieving a list of addresses in the CMM. It is to be 
understood that this is by way of example only, and data of any other type 
may be stored and retrieved in an analogous manner. 

The address data used in this example, which has been the subject of 
our experimental research, is in a data file containing postal addresses. 
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The first step is to pre-process the address data file to combine some 
redundant elements representing small variations in basically the same 
address, and to remove exact duplications so that each record is unique. The 
main objective here is to reduce the size of file needed to represent the data, 
5 so that smaller CMMs can be used. The current implementation of pre- 
processing reduces the number of records that must be stored from 26 
million in the address data file to just over 4.3 million records. 

Even before pre-processing, the address data file already contains some 
groups of multiple addresses in abbreviated form, stored in a single record. 
10 For example, the even or odd-numbered houses in a street may appear as "N- 
M Argyle Street" (say) in a single record. The procedures described here 
additionally allow consecutive numbers to be combined into an address range 
in a single record as well. 

Note that multiple passes are normally required, because the 
15 procedures are applied recursively. However, several records can be 
combined in a single pass so that, for example, the eight records covering 
house numbers 21, 22, 23, 24, 25, 26, 27 and 28 can be combined to produce 
the new record "21.28 High Street ... " (for example), if the original records 
occur successively in the address database. 

20 The following procedures are applied in pre-processing the address 

data file to obtain an input database file. 

If N records are identical, (N-1) of those records are removed. 



wo 01/01345 



PCT/GBOO/02303 



-11 - 



til 



If a consecutive range of two or more records differs in only one 
word, and that word is not the postcode, then the records are replaced by a 
new combined record using the following syntax: 

1. Numeric strings (natural numbers) whose value differs by 
5 exactly one across a consecutive sequence of (otherwise 

identical) records are replaced by a new combined string 
f;j separated by the character. Thus, for example, "21 High 

Street, JoUytown JOS 2TR", "22 High Street, Jollytown JOS 
2TR" and "23 High Street, Jollytown JOS 2TR" are replaced 
Rj 0 by the single record: "21 .23 High Street, JoUytown JOS 2TR" . 

2. Numeric strings (natural numbers) whose value differs by 
exactly two across a consecutive sequence of (otherwise 
identical) records are replaced by a new combined string 
separated by the "-" charaaer. Thus, for example, "21 H^ 

15 Street, Jollytown JOS 2TR" , "23 High Street, Jollytown JOS 

2TR" and "2S High Street, JoUyt own JOS 2TR" are replaced 
by the single record: "21-25 High Street, Jollytown JOS 2TR" 

3. Alphanumeric strings (but not postcode strings) are replaced by 
a new combined ("folded") record but separated by whitespace, 

20 and delimited by " > " and " < " characters. Thus, for example. 

"Old Farm Cottage, Ditherington, Bhstershire BL6 4DI" and 
"New Farm Cottle, Ditherington, Bhstershire BL6 401" are 
replaced by: "> Old New < Farm Cottage, Ditherington, 
Bhstershire BL6 4DI". 



nJ 
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All of the above procedures result in compressing the input data. 

Lastly, records are transferred to the input database file in a pseudo- 
random order. The intended purpose of this re-ordering is to reduce the 
occurrence of clusters of similar text strings, by distributing these more 
5 uniformly through the input database. That is, the original address database 
is supphed in what is called Tostcode Area Order*, where the file is sorted 
according to the postcode. Addresses which share the same postcode are 
then sorted according to other fields in the address database such as street 
name, building name and locality. This means that, for example, the first 

10 3000 or so addresses in the address data file all belong to the ABIO postcode 
area - somewhere in Aberdeen. All of these records will therefore have a 
much higher degree of similarity than 3000 addresses taken at random from 
the database. By taking the records in random order, there will tend to be a 
much wider variation of data presented to any particular CMM before it 

1 5 begins to get saturated. Saturation of CMMs will be discussed again below. 

In order to enter data into a CMM for storage, the text of the 
addresses has to be converted into binary code. In order to do this, each 
character is assigned a unique binary code. Figure 2(a) shows an example of 
this, where six letters are each assigned a respective six-bit binary code, in 
20 each of which only a single bit is set to 'V. 

The text to be stored is then subjected to n-tuple sampling. By this it 
is meant that each string of characters is divided into a succession of 
samples of n characters, each sample being one character on from the 
previous sample. Another way to look at this is as a "sliding window" n 
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characters wide, which moves across a stream of input characters, such that 
the "window" advances one character at a time. 

This is most readily understood by reference to Figure 2(b), where 
the word SPOTTER is sampled (for simplicity) as six 2-tuples, each 
5 comprising a successive pair of characters. 

A unique binary code is then assigned to each 2-tuple or pair of 
characters, as the result of combining the binary codes of the individual 
characters of the pair, using a binary tensor product operation. An 
example of this is shown in Figure 2(c), where the tensor product of the 

10 first 2-tuple of Figure 2(b) is formed as the cross product of the two binary 
values of the letters 'S' and T\ The resuhing matrix is then converted back 
into a single binary number simply by taking each row of the matrix in turn 
and concatenating them together. The order in which the rows are taken is 
not important, provided that it is consistent for all tensor products. It is 

15 important to note that the final single binary number resulting from the 
tensoring of each 2-tuple depends upon the order of the letters in the tuple - 
i.e. the result from **PS" is different to that from "SP". 

When all of the 2-tuples in the text have been sampled and tensored to 
produce respective binary numbers (six in this simple example), all of those 

20 binary numbers are combined by a binary OR operation to produce a final 
binary pattern or number for the text. Figure 2(d) illustrates the final binary 
pattern or number for the input word "SPOTTERS. Figure 2(e) shows the 
corresponding final binary pattern or number for the sUghtly mis-spelt input 
word "SPOTER". Note the similarity between the binary patterns of 

25 Figures 2(d) and 2(e). 



wo 01/01345 PCT/GBOO/02303 



- 14- 

By contrast, Figure 2(f) shows the final binary pattern or number for 
the input word "PROTEST". Note the marked difference between the 
binary patterns of Figures 2(d) and 2(f), even though the word PROTEST is 
an anagram of the word SPOTTER, and therefore comprises exactly the 
5 same characters. 

Thus, the final patterns for two words which are anagrams of each 
other will usually be quite different, whereas a spelling mistake will only 
affect two tensor patterns (for 2-tuples), so the overall pattern for the word 
should not be overly disrupted. 

10 Although 2-tupling and tensoring has been illustrated for simpHcity, 

higher order tupling and tensoring can equally well be carried out. We have 
foimd 3-tuphng and tensoring to be particularly efficient. 

The illustrative example of Figure 2 shows tupling and tensoring of a 
single word. In the practical example of the address data file, each record 

15 (i.e. a complete postal address) is sampled (typically in 3-tuples or "triples") 
and tensored to give a resultant binary number or pattern for that record. 
There is then generated for that record (typically using a pseudo-random 
process) a second binary pattern which we refer to as a separator, which is 
associated with the binary pattern of the record. The purpose of the 

20 separator is to represent the record which may later be found by a search 
operation, and so a record is maintained of the original data record 
represented by each separator. 

The binary pattern for each record is then entered into the CMM 
with its respective separator. That is, the binary pattern for the record is 
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applied as a row address and its respective separator as a column address (or 
vice-versa)^ and the intersections of the CMM which have both row and 
column addressed as '1' are set as 'l\ This is generally in the manner as 
described above with reference to Figure 1. 

5 All desired records are entered into the CMM in this way, which 

may be referred to as a step of "teaching"* the CMM, 

Once all of the desired data has been stored in the CMM, records can 
be recalled from the CMM when desired, by a "recall" or "search" step, as 
follows. 

10 Firstly it is necessary to enter query data ~ that is, as much of an 

original record as is available, to identify the full record. The query data is 
then processed in the same way as original data was entered in the CMM in 
the first place - that is, it is sampled in tuples, the tuples are binary coded 
and tensored, and the tensored products combined to form a final binary 

15 pattern of the query data. 

The final binary pattern thus formed is then applied as a row address 
to the CMM. Then, for each column of the CMM, for each row of the 
address set to 'l\ the number of intersections of that row and column 
which are set to "V are counted, to give a sum for that column. The 
20 sequence of sums for all of the columns gives a 1-dimensional output array 
of summed values. As a very simple example of this, Figure 3 shows the 
CMM of Figure 1, with the same row address as in Figure 1 appHed, and 
showing the array of summed values of the columns as 020100210. This 
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represents a number of combined separators that may match the input 
query represented by the row address apphed to the CMM. 

To reduce the number of potential "hits" represented by the 
separators included in the output array of summed values, a thresholding 
5 step is applied. For example, referring to Figure 2, if a threshold value of 
"2^* is applied to the output array of summed values, each bit of the array 
which is equal to or greater than "2" is set to *r, and all other bits are set to 
*0'. This then reduces the original output array of summed values to a 
binary output array. In the simple example of Figure 3, the binary output 

10 array is 01000010. Due to the simplicity of this example, this is identical to 
the original separator code applied in Figure 1, which then links to the 
original record. However, as a general mle, the binary output array will be 
more complicated, representing a number of superimposed separators, and 
will require further processing by an extractor to extract the correct 

1 5 separator for the query data and therefore link to the original record that is 
sought. 

It is quite likely that, given incomplete query data, there will be a 
number of possible matches to the query. In this case, the extractor will 
extract a number of individual separators, which are then linked to their 
20 respective records, which in turn can be listed, preferably in a ranking 
order. 

The above description outlines a data processor as one example of an 
embodiment of the invention. The essential parts of such a data processor 
1 are illustrated diagrammatically in Figure 4. 
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In Figure 4, query data is input at 10, having been subjea to pre- 
processing as outlined above. The data is then passed to a sampler 2, which 
forms n-tuples. The tuples are then coded. To this end, a tensoring means 
3 forms tensor patterns from the binary codes of the letters of the tuples, 
5 and the tensor patterns are combined by a superimposing coder 4. The 
output of the coder 4 is translated by an index-value coder 5, which outputs 
a series of values representing the positions of each respective bit which is 
set to '1' in the output of the superimposing coder 4. 

The output of the index-value coder 5 is then applied as a row 
10 address pattern to the CMM 6, which already has data stored in it. As 
described above, the CMM outputs a column address pattern, the value of 
each column representing the number of row intersections with that 
column, that are set to '1'. 

The CMM output is fed to a threshold device 7, which provides an 
15 output in binary form, indicating the columns that meet the threshold 
value. The output is then fed to an MBI processor 8 (an example of which 
is described below), which extracts all separator codes that match the 
output of the threshold device 7. 

The extracted separators are then matched with their respective 
20 input data, to provide a result list 20. This result hst 20 can then be 
subjected to a Back-Check operation (also described below), to match final 
results more closely with the original query data. 



An example of the above steps is summarised in Figure 5. 
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Figure 4 also shows a separator generator 9, which generates a 
separator code for each record that is entered into the CMM for storage, as 
mentioned above. The separator generator 9 generates separator codes each 
having M bits, and each having the same number N (N> 1 and N<M) of 
5 the M bits set to '1', The N set bits of each separator code are randomly 
chosen (although no two separator codes are allowed to be identical), so 
that the various separator codes share a minimum number of set bits in 
common. (In some other applications, two or more separator codes may be 
allowed to be identical.) 

■'O By choosing N to be greater than 1, M can be much less than it 

would be if N= 1, and therefore the size of the respective CMM can be 
reduced, thus saving space. However, N could be 1 in some applications. 

By allowing separator codes to have overlapping bits, a pluraUty of 
possible matches to an input query may be obtained. The genuine match 
1 5 can be found from the possible matches by Back-Checking. 

An alternative method to extract matches from a CMM query is "k- 
point" thresholding. Instead of selecting from the CMM output array of 
summed values those bits representing column values that are equal to or 
greater than a predetermined numerical value ('2' in the above simple 
20 example), the k highest-value bits are selected, whatever those numerical 
values might be. In practice, a threshold is determined at the time of recall 
for each CMM that returns k or more bits set to one, to implement k-point 
thresholding. In practice, we usually find that k=N. 
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An improvement to assist finding an exact match of an input query 
is as follows. When binary codes representing tensored tuples are OR-ed (as 
in the above example for SPOTTER - Figure 2), the system can "lose" bits, 
for example: 

5 Code 1: 0110000 

Code 2: 0100010 

Code 1 OR Code 2:0110010 

Note that the resultant OR-ed code (SIB, superimposed binding) has 
only 3 bits set, whereas the original codes have a total between them of 4 
10 bits set. This can causes problems in the threshold stage of the CMM in 
recall, in that too many possible matches may be listed. 

The summed separator values that are output as an array in a 
subsequent recall or search process are a result of the above SIB being used 
to teach the CMM. The summed values are thresholded to obtain the 

15 separators of the possible matching data. For an exact match of the input 
postal address to a stored postal address, the threshold can be set to the 
number of bits set in the input. But because of the "loss" of bits shown 
above, the system will give a lower threshold than "should" be given. In 
this case 3 instead of 4. This results in many more false hits from the 

20 memory. 

A solution to this is to "multiple aaivate' in the teaching stage bits 
which have two bits (or more) OR-ed on top of each other - i.e. those lines 
are counted more than once in the CMM teaching or access stage. In the 
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recall or search stage, the threshold count then includes these multiple 
counts in the number of bits set in the input. 

A number of further refinements can be incorporated into 
embodiments of the invention. 

5 Features may be incorporated into embodiments of the invention, to 

deal with skewed data. By skewed data is meant data in which certain items 
recur with a very high frequency, as compared to other items which occur 
very rarely. Storage of items of data with a high frequency of recurrence 
can cause saturation of the CMM. This will be explained in more detail 
1 0 below. 

As mentioned above, we have found that a particularly suitable 
technique for converting textual addresses into binary patterns for use with 
the CMM, was 3-tensoring or 'tripling' - that is, taking three characters of 
the input at a time, performing the tensoring operation for the binary tokens 

15 for each character, and converting the resulting 3-dimensional binary tensor 
product back into a l-dimensional binary pattern. Other options are, for 
example, 2-tensoring (as described above) or 4-tensoring. However, it was 
found that with 2-tensoring, there were simply not enough combinations of 
characters to provide a lai^e enough input to the CMM to avoid localised 

20 saturation. 4-tensoring would allow an even larger input to be generated, but 
then starts to suffer from intolerance to spelling mistakes, which is especially 
pronounced for smaller words which might be represented by only one or 
two quads. Tripling provides a reasonable compromise. 
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It was found that 37 individual characters could represent the textual 
addresses of the address data file. These were the 26 alphabetic characters, 
the 10 digits and the space. Thus, the binary tokens chosen were 37-bit 
binary patterns, each with 1 bit set, to give the maximum sparsity of code. 
5 After tensoring, each triple would be represented by a binary pattern 50653 
bits wide (37''*^37***37) with only 1 bit set. Thus each triple can be represented 
by a single number indicating the position within the 50653-bit wide binary 
pattern of the set bit. For example, the unique triple *ROA' has the unique 
triple number of 39268, meaning that the binaiy pattern has bit 39268 set. 
1 0 The input to the CMM is thus the activation of one CMM line for each triple 
in an address. 

It was found that, for the address data of the address data file, the 
inputs to the CMM would be very badly skewed. The impUcations of 
skewed data are that particvilar lines of the CMM will be activated far more 

15 times than the average over all the CMM input lines. This means that some 
Unes are used far more often than others. As data is only stored in the CMM 
on activated lines, this means that some hnes are having to store far more 
data than others, rather than the data being spread evenly over the whole 
CMM. This can lead to saturation of particular lines of the CMM (the ones 

20 which are activated far more often than others), and means that they not 
only fail to store more data, but also that they cannot reliably recall data 
already stored there. 

One possible solution to this problem is simply to expand the CMM 
horizontally, making each Une longer and longer, until there is sufficient 
25 capacity in each hne to hold all of the information that will be stored there. 
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Obviously, as the CMM has to be rectangular, this means some lines will be 
far longer than necessary, in order to accommodate the frequently used lines. 
If the CMM is expanded so as to prevent saturation of the most commonly 
used input line, the majority of the CMM will be empty. 

5 An analysis of the address data file shows that the most commonly 

used input triple occurs nearly 1.4 million times, while 91% of the input 
triples are used less than 10,000 times. This variation in the occurrence of the 
input triples means that some lines of the CMM are activated far more often 
than others, and leads to localised saturation of these Unes. 

10 One solution to this problem is to split the address data file into a 

number of smaller files according to some criteria and put each small file in 
its own smaller CMM. 

As well as the input data from the address data file being far from 
uniformly distributed, another variation from the ideal profile of the CMM 

15 inputs is that the number of bits set in each input is not consistent from one 
address to another. This is because the addresses can be of varying length, 
and in fact vary from 6 triples to 319 triples. In order to reduce this 
variation, it was decided that a good method for subdividing the address data 
file would be based on the address length. This means that for a particular 

20 file, and therefore a particular CMM, the number of input lines active would 
be more uniform. This process is referred to as 'banding'. The total number 
of different address lengths is 313 (319-6), and by dividing this by the number 
of CMMs that it was planned to use, we arrive at a set of bands into which 
each address can be placed based on its length. For example, if we decide to 

25 use 3 CMMs, we get 313/3 ^104. Therefore the bands will be 6-110, 111-215 
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and 216-319 triples. An address is placed in one of these bands according to 
how many triples it contains. 

In the limit, we could decide to use 313 CMMs, which would mean 
that each separate address length would have its own CMM. However, 
5 analysis shows that, even now, the worst case (which happens with addresses 
of length 12 triples) requires a threshold of 12860. This means that the 
separator would have to be 25720 bits wide, and one address would still have 
only a single triple stored in the CMM. Successful recall would rely upon 
that triple being included in the querjr. 

10 A better method for allocating multiple CMMs to the problem was 

required. Instead of tr)ring to split the file up into well defined blocks, it was 
noted that a more efficient method would be to add addresses to the CMM 
until a particular line became too saturated to take new data. Address data is 
then allocated to the CMMs in the following manner. 

15 1. Start with one CMM. 

2. Determine whether the first address to be stored would access any 
lines of the first CMM which are already saturated. 

3. If none of the accessed lines is saturated, store the address in the 
first CMM and continue from Step 5. 

20 4. If at least one of the lines is satxirated, store the address in a new, 

empty CMM. 
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5. Read the next address to be stored and determine whether it 
would access any lines of the first CMM which are already- 
saturated. 

6. If none of the accessed lines is saturated, store the address in the 
5 first CMM and continue from Step 5. 

7. If at least one of the Hnes is saturated in the first CMM, continue 
checking all the other CMMs to find one where none of the 
accessed lines is saturated. 

8. If a CMM is found, for which none of the accessed lines is 
^ 0 saturated, store the address at this CMM and continue from Step 5. 

9. If no CMM is found, for which none of the accessed lines is 
saturated, store the address in a new, empty CMM, and continue 
from Step 5. 

This process will ensure that no particular CMM line exceeds a chosen 
1 5 level of saturation, and that each address is stored in the first available CMM 
without exceeding this saturation level. 

The problem of skewed data may not be overcome completely by 
simply splitting up the fQe, and it was desirable not to exclude data simply 
because it was too common. Taking these two requirements resulted in very 
20 wide CMMs where only a few lines were very heavily used. While this 
approach should in theory perform well, its drawback is the amount of 
memory required to hold the CMM. Given the skewedness of the input 
distribution, it is clear that the majority of the CMM would be filled with 
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zeros. This means that the majority of the CMM is not actually holding any 
information and it follows from this that it ought to be possible to compress 
the CMM, reducing the amount of space wasted while not affecting the parts 
of the CMM which actually hold useful data. A technique for achieving this 
5 was developed - by dynamically altering the implementation of the CMM on 
a per-line basis, according to how much data the line has to store. 

The conventional method for implementing a CMM line has been to 
hold the binary pattern for that line as an array of words, as shown in Figure 
6a. This shows a single 24-bit CMM Une which has a single 2-bit-set separator 

10 in it, and its representation as an array of three 8-bit words. However, an 
alternative representation is shown in Figure 6b. This new method of 
implementing a CMM line is to store a list of the positions of the bits set to 1. 
These are the only significant parts of the CMM, and this removes the need 
to actually store all of the zeros as well. In this example, the CMM is 24 bits 

15 wide. This means the highest bit position is 23 (starting from 0), and the 
number 23 can be represented in 5 binary bits. So in this case, a 24-bit CMM 
hne with a single 2-bit separator stored in it can be represented using only 10 
bits - the two 5-bit ntunbers indicating the positions of the set bits in the 
CMM line. 

20 The implications are not immediately obvious for such a small CMM 

line, but the table in Figure 7 shows how many 2-bit-set separators can be 
stored using this new method for larger CMMs. This table assumes a 
machine word size of 16 bits. If the number of separators to be stored in a 
line exceeds the usage threshold, then it becomes more memory-efficient to 

25 store a real binary representation of the CMM line. The 3rd and 4th 
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columns show the total memory requirement for a 20000 input line CMM, 
where 10% of the lines are used 400 times, and the other 90% of the lines are 
used only 20 times each. 

There are a few points which should be noted about the figures 
presented in Figure 7. 

1. The method of storing the CMM line, whether conventional 
binary or compressed, makes no difference to the operation of 
the CMM as a whole. It is quite possible to mix ordinary and 
compressed lines within one CMM. The only difference is that 
a conventional line must be scanned for set bits during the 
recall phase in order to accumulate the summed values, whereas 
a compressed line already has the bits positions implicitly 
stored- 

2. The values of 10%, 90%, and their corresponding uss^e counts 
of 400 and 20 were chosen to illustrate the point that when 
most of the inputs fall below the usage threshold value, a 
considerable saving in memory can be obtained, especially as 
the CMM is made larger. 

3. The amount of memory required by the compressed CMM 
Imes in this example is constant, no matter what the width of 
the CMM. This is the main reason that the 10000-bit wide 
CMM shows such a large memory saving. In effect, only 10% 
of the CMM has grown to 10000 bits wide, while the other 
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90% is still using the same amount of memory as it was for a 
1000 bit wide CMM. 

4, In a real application, the number of times each input line is 
aaivated is unlikely to fall into 2 groups as in the example here. 
5 In practice, the usage count for each input line can be seen to 

climb very slowly until it suddenly grows very rapidly indeed. 
The CMM width should be chosen to be as large as is practical, 
so that most of the lines will be stored compressed, and only 
the very commonly used lines will be stored as binary CMM 
10 lines. 

By running an analysis of the address database using these new 
techniques, the data shown in Figure 8 was obtained. It shows the total 
amount of memory required to store the full address database using various 
widths of CMM. 

15 It can be seen from this table that there is a minimum memory 

requirement somewhere aroimd the 15000 bit size. In fact, going down to 
1000-bit intervals, this point is reached at 14000 bits. What this implies is 
that the advantages of storing compressed CMM lines is maximised - using 
any wider CMMs results in the extra overhead of holding very wide real 

20 binary lines outweighing the savings which can be made using compressed 
lines. From this value, we can work out how many separators can be stored 
in a CMM line before it becomes more economical to store them as real 
binary CMM hnes. 14000 bits gives us 1750 bytes of storage. Each bit 
position in a separator would require 2 bytes, and each separator has 2 bits 

25 set. So dividing this by 4 gives VIS a value of 437 separators. This means that 
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if a particular line of a particular CMM is used 437 or fewer times, it would 
be more memory efficient to store it as a compressed line. Further analysis 
shows that for this particular application, 198 memories are required, ranging 
in size from 12264x14000 bits down to 3585x14000 bits. On average, each 
5 memory has 3.7% real binary lines and 96.3% compressed lines. Of these, 
nearly 20% of the inputs to each memory are used only once during training. 
The total memory requirement for this configuration is 291.2Mb. As a 
comparison, if each CMM line was stored as a "reaP binary line, the total 
memory requirement would be 2.4Gb. The compression technique has 
1 0 therefore achieved over an eight-fold memory saving in this particular case. 
As was unpHed earlier, the wider the CMM, the greater the relative memory 
saving that can be obtained using compressed CMM lines. The table in 
Figure 9 shows the relative savings for the O^Kls detailed previously in 
Figure 8. 

15 Further pre-processing of the text may be carried out, to help in 

reducing the incidence of saturation of CMM lines. In the example of the 
address data file, this may be achieved by removing hyphen and number 
characters from an input data string, except for those characters forming part 
of the postcode. That is, the string is processed to remove unwanted 

20 characters and generate a set of tokens (i,e. sub-strings deemed to be valid 
inputs for the purpose of generating GMM input codes). The potential loss 
of information can then be made up for by more accurate matching which 
takes place in a Back-Check function. 

An example of such a tokenisation process is as follows: 

25 
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String to tokenise: 

"68 45636 1-23 31-49 SANDRINGHAM ROAD SOUTHAMPTON S018 
IJL" 

Found 9 tokens ' 
5 Token 0: "68" Remove unacceptable string from input 

Token 1: "45636" Remove unacceptable string from input 

Token 2: "1-23" Remove unacceptable string from input 

Token 3: "31-49" Remove vmacceptable string from input 

Token 4; "SANDRINGPIAM" Accepted 
10 Token 5: "ROAD" Accepted 
Token 6: "SOUTHAMPTON" Accepted 
Token7:"S018" Accepted 
Token 8: "IJL" Accepted 

As outlined above, a unique binary code is then assigned to each 
1 5 imique input character. It is useful to provide access to the mapping between 
charaaers and binary codes so that applications can "look-up" the 
charaaer/ string for a given code, and vice-versa. The actual form of the code 
is determined by three parameters. One parameter specifies the width of the 
bit field (in bits) for all codes to be used in a particular CMM. A second 
20 parameter specifies the number of bits which are to be set to logical '1' in the 
code, which is normally a small, fixed number. A third parameter may be 
provided which specifies the minimum permitted Hamming distance 
between any pair of codes used in a particular CMM. This provides some 
control over the amoxmt of "overlap" between codes used and helps to 
25 minimise spurious outputs during subsequent recall. The codes may then be 
processed and stored in the CMM, as described above. 
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Embodiments of the invention may use Middle-Bit-Indexing (MET) 
extraction to extract separators from a superimposed separator 
(conveniently referred to as an SIS) as may be produced as the binary 
output from the CMM, as described above. An example of an MBI 
5 extractor is illustrated in Figure 10. 

The MBI extractor illustrated in Figure 10 is very efficient in 
maintaining mappings between separators and the records they represent 
and, most importantly, to process an SIS by extracting any individual 
separators that are present, and retrieving the corresponding records. 

10 The MBI extractor uses the middle bits of the SIS to determine 

which buckets of a separator database to access during search. Each 
separator is stored in a bucket corresponding to the location of the middle 
bit of the bits that are set (to '1') in that separator. 

Basically, the "middle bits" of a separator are used to identify the 
15 bucket where that separator would be stored in the separator database if the 
separator in question existed. The problem is that, during a recall 
operation, an SIS is obtained which contains a number of possible separator 
codes, of which some may not exist in the system. (Recall that a separator is 
only brought into existence if it is created when entering a record into the 
20 CMM.) MBI uses an index into the separator database based on the position 
of the middle bit of existing separator codes, to find the genuine separators 
in an SIS and hence the records represented by those genuine separators. 

Figure 10 shows the type of data structure used in MBI extractors. 
Here the buckets are enumerated such that the ordinal number of the 
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bucket corresponds with the position of the middle set bit for those 
separators stored within that bucket (counting from left to right) in the 
separator database. Buckets 0 and 6 are not shown, since they are not used 
in this MBI-based example. This is simply because the separators are seven 
5 bits wide and bits 0 and 6 could not be "middle bits". 

Consider bucket 5, for example. This bucket has just one entry for 
the separator 1000011, which has the 5th bit set. If the separator 0010011 
existed in this system, it too would be stored in bucket 5. Note that the 
separator is not stored explicitly in this extractor (that is, as the full binary 

10 number such as 1100001), but rather as an array of integers representing the 
set bit positions in the separator (that is, the corresponding shorter array 
such as [0,6]). Since the bucket number is the same as the bit position of the 
middle bit for all separators in a particular bucket, the integer representing 
the fact that the middle bit is set is omitted from the array of bits set to 

1 5 avoid redundancy. 

During a recall operation, the SIS generated from the CMM is 
inspected to identify each bit position which represents a potential middle 
bit in a separator. A group of one or more set bits on the extreme left and 
right are discounted immediately, because they cannot assume a middle 
20 position. For example, if the separators are fixed to have always 5 bits set, 
then the 2 bits on the extreme left and right of the SIS can never be middle 
bits. 

Once the extreme bit positions have been discounted, every other set 
bit is a potential middle bit and the corresponding buckets must be 
25 checked. One implementation of this uses AND separator checking. This 
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uses a bitwise logical AND between each separator stored in each selected 
bucket and the SIS, If a stored separator is unchanged by the AND 
operation, the SIS must contain that separator. The number (identifier) of 
each found separator is added to a list so that the records represented by the 
5 separators can be subsequently recovered. 

The result of a search using the CMM are sometimes imperfect in 
the sense that some of the separators appearing in the SIS are spurious and 
merely a side-effect of the way CMM storage operates. This means that 
some records may be erroneously indicated as matching the input. A Back- 
10 Checker is a device which aims to verify whether each result record is a 
true possible match with the input or whether it is a spurious result (non- 
match). 

One implementation of a Back-Checker operates by counting the 
number of words in every result record which match a word in the input 

15 query. In addition, the score is modified by including the result of 
comparing the soundex code of words in the address. A soundex code 
represents the sound of a word such that similar sounding words are meant 
to have the same soundex code. Increasing the score for a matching 
soundex code is intended to improve tolerance to minor spelling errors in 

20 the query. The resulting count is used to rank the results according to how 
well they match the input. 

A particular advantage of the illustrated data processors is that a 
significant amotmt of data compression takes place in the storage of indexes 
in a CMM. This is a consequence of using multiple set bits in the separator 
25 code (i.e. more than 1 bit is set in each separator code), and the columnwise 
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summation of bits from selected rows. The former means that separator 
codes may be overlapped during the training phase (i.e. more than one 
separator code can have the same bit set), and the latter means that any- 
aliasing introduced by this overlapping can be resolved during recall. It may 
5 be noted that summation results in a kind of voting system, where selected 
rows cast a vote for a particular separator/record at the places where a bit is 
set. This provides a much more seleaive system than, for example, many 
previous methods which have (in effea) used a logical AND to combine bits 
from selected rows. The number of overlapping codes increases with the 

1 0 number of separators stored, and eventually errors may occur during recall in 
the form of additional records being selected as well as the genuine matches. 
This is also seen as a feattire of the system, where one can trade-off 
increasingly compressed storage of indexes against a small (but increasing 
with compression) probability of erroneous records together with the desired 

1 5 records. 

Those skilled in the art will readily appreciate that rows and 
columns of a matrix can readily be interchanged. For example, binary 
patterns and separators that are illustrated as being entered respectively as 
rows and columns could equally be entered respectively as columns and 
20 rows, provided that all data entry and recall is consistent in the convention 
chosen. 

Although the illustrated embodiments of the invention have been 
described by way of example as for address matching in the address data 
file, it is to be appreciated that other embodiments of the invention may be 
25 used to store and recall data of any other type. 
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In this specification, the verb "comprise" has its normal dictionary 
meaning, to denote non-exclusive inclusion. That is, use of the word 
"comprise" (or any of its derivatives) to include one feature or more, does 
not exclude the possibility of also including further features. 

5 The reader's attention is directed to all papers and documents which 

are filed concurrently with or previous to this specification in connection 
with this application and which are open to pubhc inspection with this 
specification, and the contents of all such papers and documents are 
incorporated herein by reference. 

10 All of the features disclosed in this specification (including any 

accompanying claims, abstraa and drawings), and/or all of the steps of any 
method or process so disclosed, may be combined in any combination, 
except combinations where at least some of such features and/or steps are 
mutually exclusive. 

15 Each feature disclosed in this specification (including any 

accompanying claims, abstract and drawings), may be replaced by 
alternative features serving the same, equivalent or similar purpose, unless 
expressly stated otherwise. Thus, unless expressly stated otherwise, each 
feature disclosed is one example only of a generic series of equivalent or 

20 similar features. 

The invention is not restricted to the details of the foregoing 
embodiment (s). The invention extends to any novel one, or any novel 
combination, of the features disclosed in this specification (including any 
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accompanying claims, abstract and drawings), or to any novel one, or any 
novel combination, of the steps of any method or process so disclosed. 



